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for each color information on the basis of a 
predetermined arithmetic expression from pixel values of 
pixels of the same color falling within a predetermined 
interpolation region containing the interpolation point 
among all replacement information-added image data 
output from said replacement unit, and when replacement 
information of any pixel used for calculation indicates 
replacement, using an arithmetic expression different 
from the arithmetic expression. 

2. An apparatus according to claim 1, further 

comprising: 

a compensation value calculation unit for 
calculating a pixel compensation value for compensating 
for a pixel value at the interpolation point based on a 
predetermined arithmetic expression from pixel values of 
a plurality of pixels which are positioned around the 
interpolation point and fall within a compensation 
region wider than and including the interpolation region, 
and when replacement information of any pixel used for 
calculation indicates replacement, calculating the pixel 
compensation value based on an arithmetic expression 
different from the arithmetic expression; and 

a compensation unit for compensating for the 
interpolated pixel value at the interpolation point 
output from said interpolation unit for each color 
information using the pixel compensation value at the 
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18 interpolation point calculated by said compensation 

19 value calculation unit, and outputting the interpolated 

20 pixel value as a new pixel value having all color 

21 information at the interpolation point. 

3 . An apparatus according to claim 1 , wherein 

2 said replacement unit determines whether to replace each 

3 pixel value, on the basis of defect information 

4 indicating presence/absence of a defect of each pixel of 

5 the image sensor. 

4 . An apparatus according to claim 1 , wherein 

2 said replacement unit replaces a pixel value using a 

3 pixel value of a pixel of the same color positioned 

4 neighboring the pixel. 

5 . An apparatus according to claim 2 , wherein 

2 said compensation value calculation unit calculates a 

3 pixel compensation value at an interpolation point using 

4 a pixel value having color information as a 

5 representative of a luminance component of original 

6 image data among pixels falling within the compensation 

7 region. 

6 . An apparatus according to claim 1 , wherein 

2 when target calculation pixels used to calculate the 

3 interpolated pixel value include a pixel whose 
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4 replacement information indicates, an arithmetic 

5 expression is used, which has a reduced weight 

6 coefficient comparing to a normal arithmetic expression 

7 for calculating the interpolated pixel value, or has a 

8 weight coefficient of 0 for the pixel or a plurality of 

9 target calculation pixels including the pixel. 

7 . An apparatus according to claim 2 , wherein 
^ 2 when target calculation pixels used to calculate the 

j — n 

^ 3 pixel compensation value include a pixel whose 

yl 

4 replacement information indicates replacement, an 

yj 

4j 5 arithmetic expression is used, which has a reduced 

Si 

yi 6 weight coefficient comparing to a normal arithmetic 

□ 7 expression for calculating the pixel compensation value, 

□ 8 or has a weight coefficient of 0 for the pixel or a 
Q 9 plurality of target calculation pixels including the 

10 pixel. 

8 . An apparatus according to claim 2 , wherein 

2 when target calculation pixels used to calculate the 

3 pixel compensation value include a pixel whose 

4 replacement information indicates replacement, said 

5 compensation value calculation unit outputs a pixel 

6 compensation value indicating non-compensation. 

9 . An apparatus according to claim 1 , wherein 

2 said apparatus further comprises a region 
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3 value calculation unit for sequentially receiving pixel 

4 values forming the replacement information -added image 

5 data output from said replacement unit in parallel with 

6 each other by a predetermined number of pixel lines as 

7 pixel blocks for single pixel columns to form a 

8 sub-matrix from a predetermined number of pixel blocks 

9 received successively, calculating logical OR of 

10 replacement information and sums of pixel values of 

11 pixels included in respective regions set in advance on 

12 the sub-matrix as region values of the respective 

13 regions, and parallel-outputting the respective region 

14 values in synchronism with reception of the pixel block, 

iO 15 and 

oi 

Ifl 16 an interpolation unit selectively uses the 

17 respective region values parallel-output from said 

fl 18 region value calculation unit to sequentially calculate, 

19 for each sub -matrix, interpolated pixel values at an 

2 20 interpolation point on a sub-matrix to be processed. 

y 

Q 

Q 10. An apparatus according to claim 2, wherein 

2 said apparatus further comprises a region 

3 value calculation unit for sequentially receiving pixel 

4 values forming the replacement information- added image 

5 data output from said replacement unit in parallel with 

6 each other by a predetermined number of pixel lines as 

7 pixel blocks for single pixel columns to form a 

8 sub-matrix from a predetermined number of pixel blocks 
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9 received successively, calculating logical OR of 

10 replacement Information and sums of pixel values of 

11 pixels included in respective regions set in advance on 

12 the sub-matrix as region values of the respective 

13 regions, and parallel-outputting the respective region 

14 values in synchronism with reception of the pixel block, 

15 an interpolation unit selectively uses the 

16 respective region values parallel-output from said 

17 region value calculation unit to sequentially calculate, 

18 for each sub-matrix, interpolated pixel values at an 

19 interpolation point on a sub-matrix to be processed, and 
EH 20 a compensation value calculation unit 

Cn 

in 21 selectively uses the respective region values 

□ 22 parallel-output from said region value calculation unit 

Q 23 to sequentially calculate, for each sub-matrix, a pixel 

f3 24 compensation value at the interpolation point on the 

25 sub-matrix to be processed 

11. An apparatus according to claim 1, wherein 

2 said apparatus further comprises a defect 

3 information generation unit for using relative pixel 

4 position information with respect to an immediately 

5 preceding defective pixel position as information 

6 indicating a defective pixel position of the image 

7 sensor to determine whether each pixel forming the 

8 original image data is a defective pixel, and outputting 

9 a determination result as defect information to said 
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10 replacement unit in synchronism with the each pixel, and 

11 said replacement unit determines whether to 

12 replace a pixel value on the basis of the defect 

13 information from said defect information generation unit 

14 in accordance with whether each pixel value included in 

15 the original image data corresponds to a defective pixel. 
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